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Employed were a small sample of fifth graders to 
examine techniques for assessing the Talidity of psychosocial 
maturity (PSM) and the scales used to eeasare it. Three validation 
techniques were examined: (1) Da^a obtained from self-report scales, 
teacher ratings, and peer ratings were used to generate three 
multitrait-multimethod matrices (total sample, boys, and girls) ^ and 
the criteria outlined by Campbell and Fiske (1959) were applied to 
examine these matrices; (2) a technique was devised to assess the 
degree to which independent raters could predict the pattern of 
relationships among PSM and other scale scores; and (3) PSB subscales 
were used to generate regression coefficients predicting rated 
traits. Validity studies in general and some implications for the 
validation of a new PSM scale are discussed. A major implication for 
future studies is that validation of component subscales of PSM, 
rather than of the multidimensional construct as a whole, should be 
attempted. (Author) 
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INTRODUCTORY STATEMENT 



The Center for Social Organization of Schools has two primary objec- 
tives: to develop a scientific knowledge of how schools affect their 
students, and to use this knowledge to develop better school practices 
and organization* 

The Center works through three programs to achieve its objective s* 
The Schools and Maturity program is studying the effects of school, family, 
and peer group experiences on the development of attitudes consistent with 
psychosocial maturity* The objectives are to formulate, assess, and research 
important educational goals other than traditional academic achievement. 
The School Organization program is currently concerned with authority-control 
structures, task structures, reward systems, and peer group processes in 
schools. The Careers and Curricula program bases its work upon a theory of 
career development. It has developed a self->administered vocational guidance 
device and a self-directed career program to promote vocational development 
and to foster satisfying currlcular decisions for high school, college, and 
adult populations. 

This report, prepared by the Schools and Maturity program, examines 
three techniques that may be useful in validating the psychosocial maturity 
scale that is currently being revised by the program. 
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ABSTRACT 



The present investigation employed a small sample of fifth 
graders to examine techniques for assessing the validity of psycho- 
social tnaturity (PSM) and the scales used to measure it. Three 
validation techniques were examinedcj (1) Data obtained from self- 
report scales, teacher ratings^^^nd peer ratings were used to generate 
three multitrait-multimethod matrices (total sample, boys, and girls), 
and the criteria outlined by Campbell and Fiske (1959) were applied to 
examine these matrices; (2) a technique was devised to assess the 
degree to which independent raters could predict the pattern of re- 
lationships among PSM and other sca)e scores; and (3) PSM subscales were 
used to generate regression coefficients predicting rated traits. 

Validity studies in general and some implications for the validation 
of a new PSM scale are discussed. A major implication for future studies 
is that validation of component subscales of PSM, rather than of the multi- 
dimensional construct as a whole, should be attempted. 



6 



ACKNOWLEDGMENTS 



The author would like to express his gratitude to the administration 
of the Friends School in Baltimore for their cooperation in the conducting 
of this study. I especially thank the teachers, Mrs. Jeanine Bitner and 
Mrs. Claire Loecher, for the use of their class time and their contribution 
as raters in this study. A special debt is owed to Ellen Greenberger and 
Joan Bitner Brown who made contribations in all phases of this investigation. 
I would also like to express my thanks to Alex Seidler for help in developing 
the pattern-matching technique employed here and for his helpful responses to 
earlier drafts of this report. Finally, I would like to thank Samuel Livings- 
ton, who also read and offered helpful suggestions on drafts of the paper. 



7 



INTRODUCTION 



A recent paper by Greenberger and Srfrensen (1971) provided the 
theoretical groundwork for evolving a tneasure of psychosocial maturity 
(P?M), The maturity concept developed in that paper focused on the 
skills and attitudes thought necessary to promote effective functioning 
in society. Employing an interdisciplinary model, the concept encompassed 
biological, sociological, and. psychological aspects of maturity and out- 
lined three capacities of the mature individual: effective individual 
functioning, effective interpersonal functioning, and capacity to contribute 
to maintenance of the social system. 

The multifactor scale designed to assess PSM in American society was 
reported by Greenberger et al (1971). Items were taken from an item-pool 
administered independently and for other purposes by the Pennsylvania State 
Department of Education, Items were selected on the basis of their theoret- 
ical relevance and their differential endorsement by a large sample of 5th 
and 11th graders,^ The items so chosen were subjected to a 5-factor Principal 
Components solution, the number of factors having been selected according to 
previous theoretical groupings. The resulting factors (subscales) were called 
self-esteem, openness to change, independence, identity, and social tolerance. 

Since the development of the scale, a number of substantive studies 
have focused on PSM (e,g,, Greenberger and Marini, 1972; Starr et al, 
1972). Evidence for the validity of the scale has derived, in a largely 
incidental way, from its behavior in these investigations. One recent 
study (Greenberger, 1972) has come to grips with the validity issue a bit 
more directly. This study examined the question of whether or not the PSM 

^ The latter criterion reflects the minimal logical consistency with a notion 
of temporal growth. 
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scale simply measured social desirability. Results of that study 
demonstrated that two related measures of social desirability yielded 
only minimal correlations with PSM scores. No other study has, to date/ 
dealt directly with the validity problem. 

The PSM scale is currently being revised. Nonetheless, a study 
examining the validity of the old scale should be useful for exploring 
various procedures to validate the newly-designed scale. The present 
study employs a variety of techniques for assessing the predictive valid- 
ity of the scale and also attempts to examine constxruct validity. Here, 
again, the exploratory function of this research is important in assessing 
which of two alternative methods of measurement might be more effective 
(when paired with measurement based on the PSM scale) in defining the con- 
struct via a multitrait-multimethod analysis (Campbell and Fiske, 1959). 

It is necessary to state, at the outset, some of the major limitations 
of this investigation. First, although PSM is a measure which shows incre- 
ments with age, an age-restricted sample was employed here. A readily 
available sample of fifth graders constituted the present sample. While 
this truncation of range is admittedly not desirable,^ it was felt that some 
of the important questions raised could be answered in terms of the re lative 
magnitudes of the correlation coefficients. Second, none of the raters 
who produced data for the multitrait-multimethod matrix were trained. It 
might be anticipated that even a moderate degree of training would elevate 
the magnitude of measures of relationships generated on the basis of such 
ratings. Third, the size of the sample was quite small and the coefficients 
obtained, therefore, are correspondingly unstable. Thus, clearly, the 
present investigation is not a definitive attempt to assess validity; however. 



The truncation of range would be expected to produce spuriously low 
^ correlation coefficients. 
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such an assessment should provide some concrete guidelines for future 
validity studies. 

With these cautions In mind, It Is still profitable to outline the 
Idealized expectation. It Is hjrpotheslzed that the PSM score will corre- 
late well with a measure of social solidarity and progressively more poorly 
with measures of social desirability and creative tendency. In addition, 
other (intuitively generated) evidence for the predictive validity of the 
scale will be examined. 



METHOD 



Subjects 

The subjects were 47 5th graders attending two classes in a private 
school in Baltimore. This total included 22 girls and 25 boys. It repre- 
sents all 5th graders present on two consecutive testing days in early June. 

Validation techniques 

Three validation techniques were examined for their usefulness in 
assessing the validity of PSM. First, three rating methods (self-report scales, 
peer ratings, and teacher ratings) and four traits (PSM, social solidarity, 
social desirability, and creative tendency) were used to form a 12 x 12 
matrix of intercorrelatlons for use in multltrait-multimethod analysis. 
Second, the degree to which independent raters could predict the pattern of 
relationships among scale scores was analyzed. Third, PSM subscales were 
used to generate regression coefficients predicting rated traits. 

1) Multltralt-Multlmethod Analysis ; The traits and ratings used to 
form the multltrait-multimethod matrix were devised as follows: 

Traits. Four scale measures were chosen to represent traits for 
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the multitrait-multimethod matrix. The PSM construct was the validation 

target; and hence, other measures will be described as corivergent or dis- 

2 

criminant with regard to PSM, A social solidarity scale , evolved by the 
Schools and Maturity Program as a measure of feelings of consnunity with 
others, was included as a convergent trait. Originally, this scale was 
designed for possible inclusion in the revised PSM scale, to form part of 
the evaluation of capacity to contribute to system maintenance. Items on 
this scale are presented in a true-false format. Sample items (with the 
appropriate ^'socially solid" answers in parentheses) include: *'It's none 
of my business if my neighbors are in trouble and need help" (-), and "I 
would not mind serving on a committee for my school." (+) 

3 

A modified Crowne-Marlowe (1960) social desirability scale was ex- 
pected to represent a divergent trait. Finally, a scale of creative 
4 

tendency , developed by the Pennsylvania State Department of Education as 
part of their Educational Quality Assessment (EQA) program, was included 
as a more discriminant construct. Responses to items on this scale indi- 
cate algreement or disagreement on a 5-*point scale. Agreement with items 
like, ''New places are fun to visit,'* and disagreement with items such as, 
"Pictures of grass should be colored only green" contribute to an overall 
"creative" score. There is no theoretical or empirical evidence to 
suggest that creativity and maturity, as measured by the PSM scale, should 
be related. 

Ratings . Forms for peer ratings and teacher ratings of the selected 
traits were devised by members of the Schools and Maturity Program, One 

^ The PSM scale is shown in Appendix A. 
2 

This scale appears in Appendix B. 

3 

The modified scale appears in Appendix C, 
^ The creative tendency scale is shown in Appendix D, 
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of the toachor- rating forms is shown in Figure 1; its purpose is to 



assess creative tendency. The description of an individual with high 
creative tendency was: 
This person: 

- has ideas which are often very unusual or surprislag 

- has talents (for example, writing or telling stories, 
painting, or carving) that many other children don't have 

- sometimes surprises the class with good, but unexpected 
answers 

- has his or her own way of doing things 

The description frr a high degree of social desirability was: 
This person: 

- is the kind of person who thinks it is very, very important 
for other people to like him (her) 

- does what he (she) thinks other people would like him (her) 
to do, rather than what he (she) would like to do 

- always tries to do what he or she thinks that other people 
would say is the "right" thing 

- very much likes to please the teacher 

The corresponding description for the social solidarity trait was: 
This person: 

- is the kind of person you would want to have join in on a 
class project; gives up time to help other kids even if he or 
she won't get anything out of it 

- is not selfish: likes to see other people get what they want or 
need 

- works well with other children 

- is friendly to other children, even if he or she doesn't know 
them very well 

Finally, the composite trait description for PSMwas: 

Who would get along best if suddenly moved far off to some imaginary 
planet? 

No specific talent would be needed there, but the person would need to: 

- get along well on his own: pick up useful information, make 
decisions by himself 

- know how to get along with others: act in a way that others can 
understand; figure out who to trust and how much 

- take an interest in the society: learn the customs and values, 
cooperate with other people 

The rating forms were compiled in a booklet with a cover letter broadly 

explaining the nature of the study to the teachers*^ 



The cover letter appears in Appendix £♦ 
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The same descriptions^ were used as the basis of peer ratings in this 
study. The students were asked to read the description and "decide which 
two girls and two boys in the class best fit this description." Tallies 
were made of the number of times each student was named. 

The instruments for student use were assembled into two booklets. One 
booklet contained the scale of creative tendency, the social desirability 
scale, and forms for the ratings of one's peers on these two traits. The 
second booklet contained the social solidarity scale, the PSM scale, and the 
corresponding peer rating forms. 

The student booklets were administered simultaneously to the two classes 
during two one-hour periods on successive days. The order in which they were 
administered was counterbalanced so that one class filled out the first set 
of questionnaires while the other worked on the second set. The two teachers 

jointly rated the students on all traits during the fir^t one-hour period. 

2 

2) Alternative pattern analysis : TWo independent judges rank-*ordered 
the relationships they anticipated among the four trait3 in this study. 
Rankings were done on the basis of a priori familia..:y with the concepts. 
The judges had no knowledge of the previously obt*^jned relationships. 

3) Regression analyses : Apropos of the multifactorial nature of the 
PSM scale, Campbell and Fiske (1959) warn that, "Many multitrait-multi- 
meihod matrices will show no convergent validation., [if] the trait is not 
a functional unity [p. 104]." With this in mind, it was decided that some 



Inasmuch as the same descriptions were employed by peers and teachers, the 
ratings would be expected to correlate more highly with one another than 
either one would with scale scores. The derivations reflect the construct to 
some admittedly imperfect degree. 

A paper on pattern analysis by Starr and Seidler is in preparation. 
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evidence for convergent validity might be gleaned by analyzing the 
individual subscales of PSM as predictors of various teacher- and 
peer-rated traits* Regression coefficients were derived from the subscales 
for both teacher and peer ratings of PSM, A significant multiple corre- 
lation between the subscales and the ratings would afford an inference 
of validity.^ 

RESULTS 

Multitrait-Multimethod Analysis : The major purpose of the multitrait- 
multimethod technique employed here is to establish convergent and dis- 
criminant validity for the PSM scale, Campbell and Fiske (1959) have enum- 
erated a number of criteria for the evaluation of multltrait-multimethod 
matrices* These include: 

For convergent validation: 

1* The relationships among measures of the same trait assessed 
by different methods should be high and significant. 
For discriminant validation: 

2, The relationships among measures of the same trait assessed 
by different methods should be higher than the relationships be- 
tween that trait and any other trait assessed by a different 
method* 

3* The relationship among measures of the same trait assessed by 
different methods should, in general, be higher than the relation- 
ships among different traits measured by the same method. 
4. The patterning of the trait relationships should be the same 
irrespective of the method used to assess the traits. 

It should be noted that this procedure involves making the scales more 
unitary. Ratings would still be multidimensional (over and above response 
bias). This would attenuate the likelihood of a high multiple r. 



Those criteria may now be employed to discuss the validity of the PSM scale, 

Tho multitrait-multimethod matrix for these data is presented in 
Table 1. As is common practice for such matrices, reliability coefficients 



Table 1 

are reported on the diagonal. Scale reliabilities are based on data froro 
other studies. No reliability values are available for either teacher 
ratings or peer ratings, due to time constraints. An estimate of test- 
re test reliability on these ratings could, of course, be obtained by having 
teachers and peers make their ratings again. 

Evidence for convergent validity requires the demonstration of high and 
significant relationships among measures of the same trait employing different 
methods. Correlation coefficients of ,30 or higher are needed for significance 
(£ = .05) with sample sizes like that in the present study. Of three measures 
of relationships between pairs of methods of assessing PSM, only one is signifi- 
cant: the relationship between teacher ratings and peer ratings (r « #591, 
£ = .01). Thus criterion #1 is not met. 

The first discriminant validity criterion (#2) requires that the above re- 
lationships should be stronger than the relationship of PSM to any other variable 
which is neither a self-report scale nor a measure of PSM. For each validity 
coefficient there are six relevant indices. They are the off-diagonal elements 
of the first row and first column of the heteromethod blocks. With regard to the 
relationships between teacher ratings and scale scores, three of the six perti- 
nent relationships (see first heteromethod block of figures under "Self-report 
scales" in Table 1) are stronger than that displayed by the validity coefficient 
(.16). Two of the six relationships of interest between scale scores and peer 
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ratings are larger than the relationships between these two measures 
of PSM (.17). Once again, only the validity coefficient between teacher 
ratings and peer ratings (.59) demonstrates some degree of validity 
(according to criterion #2). Here, all six of the studied relationships 
are weaker than the relationship indexed by the validity coefficient. 

It may be of interest to note where the reversals (contraindicators 
of validity) occur. For the scale-teacher rating validity coefficient, 
scaled PSM and scaled social solidarity describe a stronger relationship 
(.45), In addition, teacher-rated PSM has a stronger relationship with 
scale measures of social solidarity (.34) and social desirability (.17) 
than with the scale measure of PSM (.16), For the scale-peer rating vali- 
dator, the scale score relationship cited above (between PSM and social 
solidarity) once again attenuates the inference of validity. Peer-rated 
PSM also correlates better with the social solidarity scale (.28) than 
with the PSM scale (.17). 

Another discriminant validity criterion (#3) requires that the validity 
coefficients should generally be higher than monomethod trait interrelation- 
ships. Again the pertinent (monomethod) coefficients are examined separately 
for each validity coefficient. The teacher rating-scale score validity 
coefficient (.16) has a lower absolute value than three of the six scale 
interrelationships and five of the six teacher rating interrelationships. 
The peer rating-scale score validity coefficient (.17) is lower (in absolute 
value) than three of the scale coefficients and five of the six peer rating 
interrelationships. Finally the teacher rating-peer rating validity co- 
efficient (.59) has a lower value than three of the teacher rating m(^o- 
method coefficients and one of the six p^^^r rating coefficients. Dis- 
criminant validity cannot be established for any of the three validity 



16 



coefficients by criterion #3. Once again the teacher rating-peer rating 
coefficient fares best* 

The final criterion (#4) asks that the patterning of trait relation- 
ships be the same under all methods. The pattern of relationships is 
shown in Table 2. 



Table 2 

The best agreement is between peer ratings and scale scores* This 
seems, in part, due to the fact that the peers' ratings for different 
traits are less strongly intercorrelated than teacher ratings. Oaly the 
third- and fifth-ranked relationships are reversed. Note, however, that 
the ranking of the scale score relationships is somewhat arbitrary because 
of the inclusion of the negative coefficients. Thus, for example, there 
is less of a relationship between the maturity score and the creative ten- 
dency score (the fourth ranked relationship) than between social desirability 
and creative tendency. Again there is no compelling evidence for validity 
according to this criterion. 

In an attempt to quantify the similarity of patterns obtained by the 
various methods, the matching formula given by Feller (1968) was applied.^ 
The problem was to assign a probability value to the set of patterns ob- 
tained. This problem might suggest the use of a coefficient of concordance, 
but the more general test implied by Feller's (1968) formula, free of 
erroneous inferences of correlation, appeared to be the better choice. In 
applying the formula, a double match occurs when one item occupies the same 
position in two alternative orderings that it occupies in a (third) standard 
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The application of this formula rests on the assumption that the orderings 
obtained are not due to sampling error but reflect instead the "true" 
orderings (i.e., the same rankings that would be obtained in many repli- 
cations of this investigation). ^ 
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ordering. The probability of obtaining one or more double matches in two 
replications of a particular set of six ordered items is .1513 (n.s.). 
Note that this is a conservative estimate.^ 

Two additional matrices were generated by breaking the original sample 
into all-boy and all-girl samples. The new matrices did not appreciably 
change the picture with regard to the validity of the PSM construct, as may 
be seen in Table 3 where a summary of the multitrait-multime thod matrices i3 
presented. In examining the criterion columns of Table 3, the first three 

Table 3 

criteria for construct validity are summarized in the column forming the 
body of the table. Criterion #1 holds that the validity coefficients in 
the first column must be high and significant. Generally, this is not true 
for any of the matrices. Criterion #2 requires that all monomethod relation- 
ships to the traits of interest (PSM) should be lower than the validity 
coefficients generated by employing that method. Column 2 contains infor- 
mation on the number of reversals from this desideraturm. Only the teacher 
rating-peer rating validity coefficient fares well by this criterion. Cri- 
terion #3 ideally describes a situation where all monomethod-multitrait re- 
lationships (values in the monomethod triangles in Table 1) are weaker than the 
validity coefficients (Table 3, column 1) generated by that method. Validity 
can not be demonstrated for PSM by this criterion. 

A number of suggestive pieces of information may be gained regarding PSM 
by examining Table 3 in toto . First, it is clear that the teacher ratings 
and peer ratings, by virtue of the high validity coefficients which they 

^ Table 2 shows two double matches. Note, however, that the ranking of scale 
score relationships (the only set containing negative correlation coefficients) 
is somewhat arbitrary. The ordering is from high positive through low to 
high negative. Thus, the second match may be an artifact of this particular 
ranking scheme. 
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generate, show the best overall validity (i.e., they are most coherent). 
Secondly, on the basis of two important assumptions, it may be tentative- 
ly suggested that validity is more easily obtained with a sample of girls 
than with a sample of boys. The first assumption involved here is that 
the validity coefficient obtained between scale scores and peer ratings 
(r = .399) is non-significant only because of the small sample size. The 
second assumption may be less well founded. It holds that the differences 
found between boys and girls are non-trivial (non-chance). The adequacy 
of this assumption is difficult to assess with the data at hand. Finally, 
evidence for validity involving scale scores would appear to be more 
easily obtainable employing a peer (as opposed to teacher) rating method. 
Again, this finding rests on assumptions similar to the two stated above. 

Alternative patterning analysis : The rankings made by two inde- 
pendent judges of the relationships they anticipated among the four traits 
in this study are shown in Table 4. The probability of the rankings 



Table 4 



matching one another with one reversal (or less) is small (£^.011). 
Comparison of Tables 2 and 4 reveals that the judges produced orderlngs 
which matched the scale score rankings in (at least) two places (£^.015).^ 
The conceptual orderlngs also produced double matches for 2 of the 6 teacher- 
rated relationships (£^»015) and 3 of the 6 peer-rated relationships 
(£^.002). Overall, among the five different orderlngs (three method- 
generated and two judge-generated) , there was (at least) one quintuple 

<2 
.005). 



^ See footnote I on P.11 
2 

This is based on a generalization of Feller* s (1968) formula developed 
by Alexander J. Se idler 



Regression Analyses : Thus far, our analysis has focused on the relationship 
between total scores on a multi-dimensional trait and ratings of this composite 
trait as a whole. A source of **noise" in the ratings is the distinct likelihood 
that different raters may implicitly assign different weights to the components 
of PSM, 

Inasmuch as the focus of this study is on the validation of the PSM con- 
struct, the regression coefficients of subscales for both teacher and peer 
ratings of PSM are shown in Table 5. As noted before, this analysis is predi- 
cated on the notion that a significant multiple correlation between the sub- 
scales and the ratings affords an inference of validity. The subscales do 

Table 5 

not yield a significant overall multiple correlation coefficient for either 
teacher or peer ratings, but two subscales are better-than-chance predictors 
of teacher-rated PSM. As shown in Table 5, these subscales deal with Self- 
Acceptance and Social Tolerance. (No other trait rated by teachers or peers 
was significantly predicted by the subscales). Tangentially, it is worthy of 
note that the Independence subscale significantly predicts — and interestingly, 
negatively predicts -- teacher ratings of social desirability [t»-2.06,£^.05].^ 

DISCUSSION 

Substantive Results 

Before the results are discussed it is important to reiterate the 
cautionary note sounded at the beginning of this paper. It will be re- 
* called that this paper is in no way viewed as a definitive attempt at val- 

idation of the constructs examined here. Rather, the study is conceived as 

^ This finding, while it h^iiS a certain intuitive appeal, should not be accorded 
undue weight. It will be recalled that there were three traits other than PSM 
and two non-scale methods. Thus, the five subscales were used to generate 30 
regression coefficients of which only one was significant. This single, re- 
gression coefficient could easily represent alpha error. 
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an exploratory attempt designed to examine potential validation techniques for 

a new PSM scale. Indeed, the small number of Ss^ the truncation of range on a 

related (age) variable, and the lack of rater training in the study, attenuates 

itd proper use for actual validation. With this in mind, findings for the PSM 

construct are discussed below. 

Evidence for the validity of the PSM construct from the multitrait- 

multiinethod matrices generated from these data is generally lacking. This 

is no doubt partly due to the absence of high and significant validity co- 

1 

efficients for PSM assessed via different methods. Only teacher and peer 
ratings of PSM yield a significant (non-zero) validity coefficient. 

Reasons for this failure (the absence of convergent validation) are 
not difficult to find. First, the truncation of age-range should have a 
mitigating effect oo the observed correlations. Secondly, the small sample 
size contributes to a correspondingly unstable correlation coefficient. The 
net effect is that the coefficients obtained underestimate the true relation- 
ships; and that all of the coefficients (low or high) are relatively poor 
estimates of the actual correlation. Finally, Campbell and Fiske (1959) 
suggest that low validity coefficients emanate from two additional and dis- 
tinct situations: 

(1) one or more of the methods is not measuring the trait 

(2) the trait is non-unitary (i.e., not factorially "pure") 
Inasmuch as PSM is a multidimensional construct the likelihood of finding 
high convergent relationships is small. Moreover, it appears that the 
methods did clearly differ in their relationship with one another. This is 

.not particularly surprising in light of the relative degree of similarity 
among methods. It will be recalled that the stimuli forming the basis for 
racings were virtually identical for teachers and peers. These stimuli, by 
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other coefficients be smaller in magnitude than the validity coefficients. 
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the nature of their construction, were more similar to one another than 
either stimulus set was to the scale-stimulus. Thus, notably stronger 
relationships appear in the heterotrait-heteromethod block involving the 
two rating methods than in either of the other heterotrait-heteromethod 
blocks. The validity, diagonal for the rating (heterotrait-heteromethod) 
block reflects the same general pattern of relatively stronger relation- 
ships. The methods also differed in their ability to distinguish traits, 
Monomethod relationships are notably higher for both of the rating methods 
than for the scales. This implies that teachers and peers tend to "level" 
rather than sharpen distinctions among the traits of individuals when com- 
pared with scales. The suggested interpretation has some intuitive appeal. 
It may be argued that people tend to make finer distinctions about them- 
selves (i.e., via self-report scales) than about others. Certainly 
'•le veling" appears to be an important mode of human information processing. 
This may be especially true in situations which minimize ego- involvement. 
Alternatively, scales would probably provide better means for making dis- 
tinctions (in view of their more complex structure) than would ratings. At 
any rate, the absence of high convergence in a multitrait-multimethod matrix 
undercuts any attempt at establishing validity via that matrix. 

Finally, while evidence for validity is quite scant in this study, 
some results bear further examination. The predicted patterning of re- 
sults by two independent raters yielded patterns similar to the one which 
was obtained for scale score relationships beyond a chance level. ' Indeed* 
there was a tendency toward significant similarity among the patternings ob- 
tained for the three methods. Also noteworthy was the fact that two of the 
five subscales yielded significant regression coefficients in predicting 



teacher ratings of PSM. The remaining r-^-^d traits were also examined 
via a regression analysis. While PSM ratings were not significantly pre- 
dicted by the subscales taken together, two subscales individually predicted 
teacher-rated PSM. 

One further caution is in order with regard to the results of the re- 
gression analysis. Despite the fact that the subscales constitute the PSM 
self-report measure, thus implying good a priori grounds for their use as pre- 
dictors of rated PSM, the statistical fact remains that, overall, three of 40 
(5 subscales x 2 rating methods x 4 traits) regression coefficients were sig- 
nificant. Once more the evidence should only be regarded as suggestive. Alpha 
error remains a plausible alternative explanation of these findings. A study 
that was not exploratory would, of course, examine only the regression co- 
efficients which had an a priori relationship to a particular trait. 

RECOMMENDATIONS FOR FUTURE ATTEMPTS AT VALIDATION 
The exploratory nature of this research has been referred to throughout 
the paper. As has been noted, the PSM scale is currently undergoing ex- 
tensive revision, and the revised scale will become the basis for the major 
attempts at validation. As had been anticipated, the present investigation 
has implications for the procedures in subsequent studies. 

First, it should be noted that the multitrait-multimethod studies 
have gained currency as the sine qua non of validation efforts. Yet, 
it is not widely realized that some authors have found difficulties with 
the method. Campbell (1960) has outlined and argued against a number of 
the problems which have been raised. A recent paper (Wallace, 1965) came 
to grips with the issue of criteria. There Wallace raises a cogent question: 

^ It will be recalled, however, that the overall ability of the subscales to 
predict rated PSM was nonsignificant. 
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••Would a systomatic study of the intercorrelations of .tests. . .valid 
for rating criteria reveal. .only. .a 'good guy' or 'impressive-fellow' 
factor'*(p.412, italics added]. In the present study, higher correlations 
between teacher ar.u peer ratings than between ratings and scale scores 
might suggest just such a factor (in view of the minimal instructions to 
the raters) . 

A provocative paper by Ebel (1961) subjects the concept of validity 
to careful study. He observes that psychology, in its emulation of 
"harder" sciences, has failed to note the lack of concern in these other 
disciplines with validity. This is so despite the fact that some quantified 
properties lack consistency when measured by different procedures. Moreover, 
Ebel submits that newer methods in hard sciences are not justified on the 
basis of validity, but rather on the basis of superior reliability. He 
also suggests the ludicrous nature of attempting to check scores on new 
(and hopefully better) instruments against less "good" measures of the trait 
of interest. In dealing with complex traits or criteria, it is clear that 
attention must be paid to interrelationships among measures. Still, Ebel 
cogently raises the question of whether we are being overzealous in our 
pursuit of validity. Ebel's remarks address criterion and prediction 
problems. In the important preliminary procedures for construct validation, 
the domain of the construct must be clearly articulated (Nunnally, 1967). 
These procedures essentially involve examination of relationships among 
measures which are potentially expected to be within the domain. Given 
that some measures fail inclusion in the domain, such measures will be less 
"good" indicants of the construct. If such measures are included in a multi- 
trait-multimethod study, one might be in the position of attempting to 
establish construct validity using a relatively new measure that relates to 
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the construct better than the other measures included in the study. 

Given the complexity of traits and methods in this study, it should 
not be at all surprising to find tnonotnethod coefficients which describe 
stronger relationships than monotrait coefficients. Relatively high method 
variance alone can not be taken as an indictment of the adequacy of the 
method. One can sho\* evidence of some construct validity despite high 
method variance. This should not be taken to mean that multitrait- 
multimethod studies are valueless. It does suggest that we may be according 
such studies undue weight. The critical question prior to validation must 
be what end will the study serve. If the end is prediction, the criterion 
must be of prime concern. If the end is understanding, intercorrelations 
may be more informative. However, successful multitrait-multimethod studies 
may require considerable investment to produce this information. Reduction 
of method variance for complex traits may require a substantial effort to 
align the methods. The upshot of such effort may be little more than the 
production of a number of interchangeable methods some never to be em- 
ployed again. If this is a desideratum, the findings dfl^he present study 
are suggestive of mechanisms improving the quality of multitrait-multimethod 
matrices in future studies like this one. 

We have discussed earlier the difficulties involved in validating 
measures of multidimensional constructs. In future studies of PSM, indi- 
vidual subscales should probably become the focus of validation efforts, 
and careful descriptions of the trait assessed by the subscalc should be 
created for use by the rater. Raters need to be cautioned against ''halo 
effects" and their operation in human judgment. And, finally, the evi- 
dence that girls' PSM scores show somewhat better validity must be thought 
through and procedures devised to determine why a sex difference occurs. 
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It Is clear that construct validity cannot be purchased cheaply. 
Programmatic research in establishing the domain of the constructs should 
precede multitrait-multimethod studies. The articulation of the domain of a 
construct provides useful information on alternative methods which might be 
employed. Absence of such information leaves open a number of alternative 
explanations of obtained results. Thus, in the present study, any one or 
more of tho measures employed may not be part of the domain of the construct. 
It could well be argued that multitrait-multimethod studies are ujjeful as 
the capstone of programs of research on constructs; and that thwir early 
application may be of limited utility. 

Clearly, with PSM there may be more important goals to examine. Does 
a higher score indicate effective functioning? In what ways is thin true? 
For example, is a high Independence score associated with better individual 
functioning? Once such hypotheses are developed, it is critical to evolve 
behaviural criteria where possible, in order to obviate exclusive reliance 
on ratings of behavior by others. 
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Table 2 



Patterning of Monoroethod Relationships: Criterion 4 



Methods 



Rank 


Scale Scores 


Teacher RatlnKS 


Peer Ratings 


1 


PSM-SS(.45) 


PSM-CT(.72) 


PSM-SS(.76) 


2 


SS-SD(.30) 


SS-SD(.68) 


SS-SD(.47) 


3 


PSM-SD(.02) 


PSM-SS(.63) 


SS-CT(.46) 


4 


PSM-CT(.Ol) 


SS-CT(.52) 


PSM-CT(.45) 


5 


SS-CT(-.04) 


PSM-SD(.36) 


PSM-SD(.37) 


6 


SD-CT(-.21) 


SD-CT(.15) 


SD-CT(.13) 



Note: - PSM = psychosocial maturity; SS = social solidarity; SD » 
social desirability; CT = creative tendency. 
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Table 3 



Summary of Three Multitrait-Multimethod Matrices Examining Validity Evidence 

for the PSM Construct 



Methods 


!• Validity 
Coefficients 


Criteria 

No. of reversals 
of six possible 


(invalidating coefficients) 
inval idators 
III.^ 


Ma i n fiamnl 


e (Boys and Girls Combined) , n = 47 




1. Scale - 
teacher rating 


.159 


3 


5 


2. Scale - 
peer rating 


.172 


2 


3 
5 


3. Teacher ratini^ — 
Peer rating 


* 

.591 


0 


J 

1 


•» 


Girls, n = 21 






1. Scale - 
teacher rating 


.169 


5 


4 
4 


2. Scale - 
peer rating 


.399 


1 


2 
3 


3. Teacher rating - 
Peer rating 


.736* 


0 


0 
3 


Boys, n * 26 


1. Scale - 
teacher rating 


.111 


3 


3 
6 


2. Scale - 
peer rating 


-.085 


5 


4 
6 


3. Teacher rating - 
Peer rating 


.462 


1 


4 
2 



a. No. of row and column coefficients demonstrating stronger relationships than 
the validity coefficient. 



b. No. of monomethod coefficients demonstrating stronger relationships than the 
validity coefficient. 

* ✓ 
2C..01 
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Table 4 



Predicted Patterning of Relationships 



Rank Rater 

#1 #2 

1 PSM-SS PSM-SS 

2 SS-SD SS-SD 

3 PSM-CT PSM-SD 

4 PSM-SD PSM-CT 

5 SS-CT SS-CT 

6 SD-CT SD-CT 

Note - PSM » Psychosocial Maturity; SS » Social Solidarity; 



SD » Social Desirability; CT = Creative Tendency 
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Table 5 



Raw Regression Coefficients for Regression of Teacher Ratings and 
Peer Ratings of PSM on the PSM subscales 



Ratings of PSM 



PSM Subscale 



Teacher Ratings 
Regression Standard 
Coefficient Error 



Peer Ratings 
Regression Standard 
Coefficient Error 



1. 


Se If-Acceptance 


** 

0.45 


0.18 


0.49 


0.69 


2. 


Openness to Change 


-0.04 


0.11 


-0.15 


0.41 


3. 


Independence 


-0.10 


0.12 


0.82 


0.44 


4. 


Identity 


0.01 


0.24 


-1.26 


0.93 


5. 


Social Tolerance 


* 

0.52 


0.22 


0.79 


0.85 



£<.05 



** 



£_<.02 
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APPENDIX A 
Psychosocial Maturity 



Th« questionnaire format for the 54 itcws of the psychoBocial 
maturity scale is given below. The asterisk indicates which response 
or responses are "mature." 



DIRECTIONS; Please mark each statement in the following way: If the 
statement describes how you usually feel, check "Like me". If the 
statement does not describe how you usueJ-ly feel, check "Unlike me". 
There are no right or wrong answers. 

Subscale: 

Self-Esteem ^^^^ Unlike me 

1. Luck decides most things that happen to me. » 

2. Someone always has to tell me what to do. » 

3. It takes me a long time to get used to anything new. » 

U. I'm popular with kids my own age. » 

5. If I work hard, I can be what -I want to be. * 



6. If I stick to something long enough, I can make it 
work. 

7. If I work hard, I can get a good Job. 

8. If I have something to say, I usually say it. 

9* There isn't much of a chance for a person like me 
to succeed in life. 

10. If I work et something long enough, I will succeed. 



A- 1 
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SOME PEOPLE SAY THAT IN ORDER TO KEEP UP IN A FAST MOVING WORLD IT WILL 
BE IMPORTANT TO KEEP LEARNING AND STUDYING ALL DURING OUR LIVES. OTHER 
PEOPLE SAY THAT ONCE A PERSON FINISHES SCHOOL, HE SHOULD BE ABLE TO HANDLE 
ANYTHING THAT COMES ALOKG. 

DIRECTIONS ; Check the one column that best describes you. If you wish to 
change an answer, erase completely your first mark. 

DO YOU THINK YOU WILL HAVE TO KEEP LEARNING AND STUDYING (IN OR OUT OP 
SCHOOL) IN ORDER TO: 



Subscale: 

Openness to It will It will It will be It will 

Change be very be quite somewhat not be I can 

important important important important not say 

11. Make good decisions in ^ ^ 

voting. 



DIRECTIONS : TRY TO PLACE YOURSELF IN THE FOLLOWING SITUATION: 

BEFORE SCHOOL BEGAN ONE MORNING, YOU AND A GROUP OF CLASSMATES WERE 

HAVING A TALK ABOUT THE YEAR I989 AND YOU WERE TRYING TO IMAGINE YOURSELVES 

GOING TO SCHOOL IN I989. ITEMS 12 to 22 ARE SOME OF YOUR CLASSMATES IDEAS. 



I do 

I accept I can not 

it not say accept it 

12. There will be no marks ar\<i no report ccurds. 

Pupils will talk over their work with their ^ 

teachers as often as they like. 



13. Schools will be open 2k hours each day. 
Pupils can use the building at any time. 

Ih. Pupils will work with teachers alone or in 
small groups. 

15. All the latest and best reading materials 
will be quickly available through a computer. 

16. There will be TV, movies, records, and tapes 
which pupils can use by themselves. 
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I do 

I accept I can not 
it not say accept 

17. Pupils will have the use of a computer for ^ 

arithmetic and many other things. 



18. There will be quiet places to learn and 

study on one's own. * 



To learn about the people and the language 
of another country, pupils will spend some 
time living in foreign countries. ' * 



To leairn awout different people in this 
country, pupils will spend time living in 
different sections of the United States. * 



21. Pupils will learn ii, factories, laboratories, 
hospitals, museum^ theaters and offices. 
Pupils will visit these places if they wish 
to leeurn about them and about the people in 
them. 



22. Pupils will talk with others all over the 

world by way of satellite. » 



19. 
20. 



DIRECTIONS: READ EACH STATEMENT, THINK ABOUT WHAT YOU HAVE DONE IN THE PAST 
IF YOU WERE EVER FACED WITH THE SITUATION AND MARK YOU ANSWER BY CHECKING 
THE COLUMN THAT FITS BEST. IF YOU NEVER FACED THE SITUATION, TRY TO 
IMAGINE WHAT YOU WOULD DO. DON'T SPEND TOO MUCH TIME ON ANY ONE ITEM. 
Subscale: ^^3^ 3^^^^ ^^^^ 

Independence Always the time times seldom Never 

23 • I like to earn my own money ^ n 

when I can. 



21*. A man should work and earn his 
own living if he can. 

25 • A man should vote the sane way 
his friends do. 

26. People should' not be allowed to 
say what they think. 
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DIRECTIONS ; THE ITEMS BELOW ARE STATEMENTS ABOUT OCCUPATIONAL CHOICE 
AND WORK. OCCUPATIONAL CHOICE MEANS THE KIND OF JOB OR WORK THAT YOU 
THINK YOU WILL PROBABLY BE DOING WHEN YOU FINISH ALL OF YOUR SCHOOLING. 
IF YOU AGREE OR MOSTLY AGREE WITH THE STATEMENT, PUT A CHECK IN THE SPACE 
HEADED TRUE, IF YOU DISAGREE OR MOSTLY DISAGREE WITH THE STATEMENT. PUT 
A CHECK IN THE SPACE HEADED FALSE. 

Subscale: 

Independence True False 

27. I plan to follow the line of work my parents suggest. » 

28. I'm not going to worry about choosing an occupation until 

I'm out of school. » 



29* Your parents probably know better than anyone else which 
occupation you should enter. 

3*). Why try to decide on a Job when the future is so uncertain^ 

31. I seldom think about the Job I want to enter. 

32. It doesn't matter which Job you choose as long as it 
pays well. 

33. You can't go very far wrong by following your parents' 
advice about which Job to choose. 

3k. Whether you're interested in a particular kind of work is 
not as important as whether you can do it. 

3 5» You get into an occupation mostly by cheuice. 

36. It's who you know, not what you know, that is 
important in a Job. 

37. When it comes to choosing a Job, I'll make up my own mind._ 

38. I have little idea of what working will be like. 

39- Choose ai: occupation, then plan to enter it. _ 

^0. I really can't find any work that appeals to me. 

Choose a Job in which you can be famous. 

^2. The most important part of work is the pleasure which 
comes from doing it. 

^3. Why worry about choosing a Job when you don't have 
anything to say about it. 
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Subscale: 
Identity 








True False 








I don't know how to go about getting into the kind of ^ 
work I want to do. 






1*5. 


I don't know what courses I should 


take in 


school. * 






1*6. 


I know very little about the requirements of Jobs. * 






1*7. 


I can't understand how some people 
what they w6mt to do. 


can be so set about ^ 


• 




DIRECTIONS: READ EACH QUESTION CAREFULLY AND DRCTDR HOW Ynn ppft. ^^0117 tt 
THERE ARE FIVE POSSIBLE ANSWERS TO CHOOSE FROM. BE SURE TO ANSWER EACH 
QUESTION. CHECK ONLY ONE SPACE FOR EACH QUESTION. 




Subscale: 

Social 

Tolerance 




I would I would I would 
I would not mind rather dislike I can 
like it it not it not sc 






1*8. 


How would you feel about sitting 
in class next to a person whose 
skin color is different from 
your own? 












How would you feel about having 
as a best friend a person whose 
ideas about God are very 
different from your own? 










50. 


How would you feel about playing 
on the same team with a person 
whose ideas about God are very 
different from your own? 










51. 


How would you feel about sitting 
in class next to a person whose 
ideas about God are very different 
from your own? 










52. 


How would you feel about having as 
best friend a person whose family 
is much poorer than 'yours 7 










53. 


How would you feel about playing 
on the some team with a Y^'^cr.on 
whose family is much poorer lhan 
yours? 






* 






How would you feel about sitting 
in class next to a person whose 
family is much poorer than yours? 
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APPENDIX B 
Social Solidarity 



Please read each item carefully. Place a checK In the ^pace vhich \)e8t 
describes hov you feel. Do not leave any Items unaxxsvered. 

Mostly Mostly 
agree disagree 

1. I like the people In my neighborhood. * 

2. I tend to forget about the feelings of others when 

I'm doing something that Is import€uit to me. * 

3. A person Is responsible only for the well-being of 

his family, relatives, and close friends. * 

k. Students should take "part In the group activities 

of their class. * — 

5. I do not like other kids to ask me to help them 

with their homework. * 

6. Most people pretend their troubles are worse than 

they are to get sympathy. * 

7. It is more satisfying to work for a purely personal 
goal than to work for a goal held by a group you 

belong to. * 

8. Most i>eople like to help others. * 

9. A person shoxild not be respected for something he 

did, if it interfered with the well-being of others. * 

10. Sometimes it's necessary to push people euround a 

- little to get what you want. ^ 

11. I do not like to teach other kids how to do things. 

12. I like most people I meet. * 

13. It's natural for each person to think that his 

family deserves to have things better theui any other. * 

lU. If you really enjoy doing something, you should do 

it even if it causes problems for other people. 

15. It's none of my business if my neighbors are in 

trouble ar*d need help. - 

16. I don't see much point in trying to do things for 

others unless they can do you some good later on. ^ 
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Mostly Mostly 
agree dlaa&ree 



17. I would enjoy working with others to plan a 
claaa outing. 

18. I would not want to pay taxeo to run schools if 
I did not have children. 

19. I'm not the sort of i>erbon who goes out of my way 
to help other*. 



20. I would not mind seizing on a coxmnittee for my school* * 

21. People who ask for help are giving up their pride. . 



22. I admire u good follower ac much as I admire a 

good leader. _ 

23. I'd like to be port of a family where the parents 
do not expect their children to do Jobs around 
the house. 

2U. Once you start doing favors for people, they'll 
Just walk all over you. 

25. When you get right down to it, no one is going to 
care much what happends to you. 

26. I don't like to lend money to my friends. 

27. When the chipa are down, I don't have any friends 
I con really count on. 

28. I don'w see why my parents chould pay taxes to 
provide food for the poor people of other states. 

29. When a new person moves into my neighborhood, I 
try to be friendly. 

30. If I had to choose between helping raise money for 
a neighborhood project and enjoying Diy own free 
time, I'd probably keep ray freedcsm. 

31. I don't like to lend my extra pencils or pens in ^ 
school. 

32. If I had the choice of working with somebody so each 
of us could get part of a prize, or competinR 
against him so one would get it all, I'd compete. 
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APPENDIX C 



•▼A* «r.» 



Social Desirability 

Xruc* Kalsc 

-1. r.avoiT hoGiua;:*:^ i;o go o/.-: of juy waj^ to Iialp 
:•). J.; 1g co»rtfat:ix:.rj h:::cd ^c; .. j ::o i;!::!! cy 



6. ?: t-o;risfix:^s foal cn^ry vl:c:i i: con'u sat riy 
v/cy. 

I a>;aj^c cetera ilu 7. abcui: he; I d:;or;r;. 

o. i'l/ cc»l>io r-Ginorc at hov:.\ c::;a ac ^oou ao v/licn 
I eat out a rcootciiivcA::, 

9. I/: T. ccii7.d ;.;icO a u^/.*..! paying 
r.rrcl bc: cuy.*2 1 ;:af; p.ot coc--^ C Mr.vlc prob;ioly 
CO >.t. 

/.O, A ?.a\7 tiuKis I have giver up cloj.n.^, coxcthi-is 
bacauce I ^houjht I dicu't have the ability 
to do it. 

ii. 5: like to gesGii^ at tutnc:n. 

J.2. ahire iiavo boo:: tivc^Ci X7u:u X d;u' :iot ^a^l l^llx 

iclaj; x?ha»: v.y ceaciicrrf: caritcd liio to c!o, cv?.n 
'd-ough V 2c;-/aw they v-v;, -•?'>h':, 

13. r:-: ra': .. -c /.'..i u.-ii!:/. ■ »/ ;,:r.iyi: .i 

7. can ?:oirx..::bov --'piayin,^ cJxk" to p?: cut of 

15. T,tcre have been tiL'Os X'hvza I too: r.<lvaatage 
of acmaone. 
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.Mil.. 7 T 



'-'^..Aj or.-; 



>x - roii • '..;0 1:.- 
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Lc-a happoi*: (::> chii: o. ly gou ^'luii; they 

:•: ::.;.vj aov^/r i.' .y i.o;^toLhj.n3 that 
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APPENDIX D 



Creative Tendency 



SECTION F 



^>. ^£CTiOMS ; READ EACH STATEMEiNT CARS- 
rOLLY. BLACKEN TWE CIRCLE WHICH BEST 
TELLS KOW YOU FEEL ABOUT THE STATE- 
MENT. FOR EACH ITEM BLACKEN ONLY ONE 
CIRCLE. 



Strongly diftogrtt 
Disogrtt 

Uncertain 
A^reo 
Strongly Qgr*« 




©©©©© 



1. 't the las: page of a book is missing, th« 

book IS not worth reading ©0000 

2. 1 vvauid Itke la moke up a new song <S)®00O 

3 New words ore fun to learn ®©0©© 

•*. T V. news shows ore boring ©©0©(S) 

5. I would like to learn a new gome even if I 

:o:;cot it <S)©©©0 

C. The best lessons contain only one idea. • . .©©©©© 
/. New places ore fun to visit ®<S)©(D)0 

3. i like to reoliy do more than the teacher 

^:.k,(or <X)©0eo 

9 1 x'un\ »hot if 10 (oolisii to borrow other 

, • \r\ .fU,«; OOwr^'iV'O? 

> * ..... 

^ b*:st loys ciro tiv; kind that Can be 

taker, opoit.., G0jJO('^)(V 

^ .11 iiKc to meet new clossmotes ® 0©©0 

;2 Crooting new words is dumb ©000® 

I 3. it might be fun to try new gomes ®0©©0 

U* Lcorning how to do things is more impor* 

o'lt thon getting excellent morks ©©000 

'5 : like to try-new things ©©©©© 

16. i like to moke things without following 

directions ©@©®© 

1 7. Pictures of gross should bo colored only 
rn?^"" ©<i>©©® 



Strongly disagree 
Disogree 

Uncertain ■ 
Agree 



Strongly ogree 




-©@©©o 



18. Only odults con run a house ©000® 

19. I think I could moke up stories os good 

OS those in books ®©©0© 

20. You hove to be grown up to think up o 

reolly good idea ©000® 

21. I don't like chonges ©000® 

22. It is importont to get the right onswer even 

if I don't know how I got it ...©000® 

23. i would rather ploy a gome I know thon 

leorn o new one . . . ; ©000® 

24. I cn|oy learning haw to do something in o 

new ond different woy (J0^^c^(o)O 

25. The best way is the old way ., . . .©00(ji)® 

2o. It would be fun to toke o picture through a 

goldfish bowl ® 0000 

27. I would rather copy poems from o book 

than moke them up , , . .00O([)® 

28. It IS not much fun to visit new places .... .©00O® 

29. I want to find out things thot nobody else 

knows .....®O0O0 

30. Games ore not fun if you lose 0000® 

31. The more pieces in a puzzle, the better I 

like It , ,,, ®0O00 

32., The best friends ore the ones who like the 

some things as I do ©OO0® 

33. Lessons thot hove a lot of different ideas 

in them are reo My good ©0000 

34. ' I don't like to learn new words ©0O0® 

35. News shows on T.V. ore interesting to 

watch ®0O0O 

36. A good drowing hos to look like the reol 

thing , , ©000® 

37* i like to speak to the closs and onswcr 

questions obout my talk , . ®000O 

Suifiing o *^ong thot nobody else knows is 

si:i • ' (^^i)Ort^® 

'J*'* ! Icr-t pu'i t o\ n -Jory i*; nu %\\t)r}, you 

t lUHt H|i llir t'O'''' ' ^ 

'10. i'KtiMCs of 9rass could be painted any 

color .., ®000O 

A), Making up stories is silly ©000® 

42. It would be fun to drew o picture whi le ^ 
stonding on your head ©0000 

43. Now kids ore not fun to meet ©000® 

44^ It would be o waste of time to take o 

photograph through a fishbowl ©000® 

45. I think thot it is foolish to copy other 

• people's work ®©0©Q 
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APPENDIX E 

rilE JOHNS HOPKINS UNIVERSITY • BALTIMORE, MARYLAND 21218 



CENTER FOR SOCIAL ORGANIZATION OF SCHOOLS 
301-366-3582 



TO THE TEACHER: 



The questionnaire being given to your class is part of a survey 
being done by people in the Pennsylvania State Department of Education 
and the Johns Hopkins University. This survey is part of an ambitious 
study of some important non-academic traits in human development. 
Perhaps the clearest picture of where a person stands on a trait emerges 
from looking at how an individual is seen by others as well as how he 
sees himself. Children's teachers and peers are both valuable "observers." 
On the next pages, we are asking you to help us develop this method of 
looking at aspects of a child's personality. Obviously, the success of 
this endeavor depends a great deal on your candor and your willingness to 
make clear distinctions among your students. Your judgements will be 
treated with absolute confidentiality. 

The next 3 sheets describe different traits. The trait descriptions 
are exactly the same as those given to your students. We have done this 
purposely in order to maximize the overlap in content of the traits that 
both you and your students will be judging. Please rate all of your 
students on the trait. Rate the students relative to one another accord- 
ing to where they belong with regard to the numbered categories along the 
"trait line." If you rate them relative to one another you should be able 
to use all of the numbered categories. Please write the names of the 
students at a particular point on the trait line directly unde^ the number. 
If you work in pencil you will be able to readjust your discriminations 
as you think of more students. We are grateful for your conscientiousness 
and cooperation. Thank you. 



B. James Starr, Ph.D. 
Ellen Greenberger, Ph.D. 
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